Non-transitory storage medium storing image transmission program, image transmission device, and image transmission method

ABSTRACT

A non-transitory storage medium storing an image transmission program that is executed on an in-vehicle device mounted in a vehicle having an imaging unit configured to image surroundings of the vehicle to acquire an image and a communication unit configured to perform communication with an information center, the image transmission program including: an image acquisition step of, in a case where a certain mark target is located at an intersection, and an occupancy ratio of an occupancy area of the mark target in a block of a minimum range divided by a plurality of roads to an area of the block is equal to or less than a given ratio, causing the imaging unit to acquire an image of the intersection including the mark target; and a transmission step of causing the communication unit to transmit the image acquired to the information center.

INCORPORATION BY REFERENCE

The disclosure of Japanese Patent Application No. 2017-089694 filed onApr. 28, 2017 including the specification, drawings and abstract isincorporated herein by reference in its entirety.

BACKGROUND 1. Technical Field

The present disclosure relates to a non-transitory storage mediumstoring an image transmission program, an image transmission device, andan image transmission method.

2. Description of Related Art

In the related art, in a case where there is an intersection(hereinafter, referred to as a guide intersection) to be guided, such asright or left turn, in front of a vehicle in a moving direction,guidance of the guide intersection is performed. In the above-describedcase, mark target candidates that are candidates for a mark target to bea mark are acquired, and in a case where a mark target candidate is usedas a mark target in the past, appropriateness of the mark targetcandidate as a mark is determined based on a visual recognition form ofan occupant to the mark target candidates accompanied with passingthrough the guide intersection. A traveling guidance system configuredto perform guidance of the guide intersection using a mark targetcandidate having appropriateness equal to or greater than a referencevalue as a mark target among the mark target candidates at the guideintersection based on the determination is known (for example, seeJapanese Unexamined Patent Application Publication No. 2014-163814 (JP2014-163814 A)).

SUMMARY

In the traveling guidance system of the related art, there is nodisclosure concerning a method of efficiently collecting data of themark target candidates. In particular, there is no disclosure concerningefficient data collection at an intersection where collection is notneeded.

Accordingly, the disclosure provides a non-transitory storage mediumstoring an image transmission program, an image transmission device, andan image transmission method capable of efficiently collecting an imageat an intersection.

A first aspect of the disclosure relates to a non-transitory storagemedium storing an image transmission program that is executed on anin-vehicle device mounted in a vehicle having an imaging unit configuredto image surroundings of the vehicle to acquire an image and acommunication unit configured to perform communication with aninformation center. The image transmission program includes an imageacquisition step of, in a case where a certain mark target is located atan intersection, and an occupancy ratio of an occupancy area of the marktarget in a block of the minimum range divided by a plurality of roadsto an area of the block is equal to or less than a given ratio, causingthe imaging unit to acquire an image of the intersection including themark target, and a transmission step of causing the communication unitto transmit the image acquired to the information center. Theinformation center may be, for example, a traffic information center, aprobe center, or the like.

For this reason, it is possible to reduce the acquisition amount ofimages by acquiring an image in a case where the occupancy ratio of theoccupancy area of the mark target in the block to the area of the blockis equal to or less than the given ratio.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection.

In the non-transitory storage medium according to the first aspect ofthe disclosure, the image acquisition step of the image transmissionprogram may include causing the imaging unit not to acquire the image ofthe intersection including the mark target in a case where the occupancyratio is equal to or greater than a given ratio.

For this reason, in a case where the occupancy ratio of the mark targetis equal to or greater than the given ratio, determination is made thatacquisition of an image is not needed.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection by preventing transmission of an image of alarge and conspicuous mark target to the information center.

In the non-transitory storage medium according to the first aspect ofthe disclosure, the image acquisition step of the image transmissionprogram may include causing the imaging unit not to acquire the imagerelating to the intersection in a case where the mark target occupiesthe entire area of the block.

For this reason, in a case where the occupancy ratio occupies the entirearea of the block, determination is made that acquisition of an image isnot needed.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection by preventing transmission of an image of aconspicuous mark target occupying the whole of one block to theinformation center.

In the non-transitory storage medium according to the first aspect ofthe disclosure, the image acquisition step of the image transmissionprogram may include causing the imaging unit to acquire the image of theintersection including the mark target at a place between a position infront of the intersection by a predetermined distance and theintersection.

For this reason, it is possible to restrict a section where the imagingunit is caused to acquire an image, to a place between a position infront of an intersection by a predetermined distance and theintersection.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection by restricting a section where the imagingunit is caused to acquire an image, to a place between a position infront of the intersection by a predetermined distance and theintersection.

In the non-transitory storage medium according to the first aspect ofthe disclosure, the image acquisition step of the image transmissionprogram may include specifying the occupancy ratio using map data.

For this reason, it is possible to specify the occupancy ratio based onthe map data.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection using the occupancy ratio specified based onthe map data.

In the non-transitory storage medium according to the first aspect ofthe disclosure, the image acquisition step of the image transmissionprogram may include causing the imaging unit not to acquire the imagerelating to the intersection in a case where the mark target is apredetermined large facility.

For this reason, determination is made that acquisition of an image of apredetermined large facility is not needed.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection by preventing acquisition of an image of apredetermined large facility.

In the non-transitory storage medium according to the first aspect ofthe disclosure, the block may be positioned at a left front corner ofthe intersection in left-hand traffic or at a right front corner of theintersection in right-hand traffic.

For this reason, it is possible to prevent acquisition of an image of amark target at the left front corner of the intersection in left-handtraffic or at the right front corner of the intersection in right-handtraffic, and to prevent transmission of the image to the informationcenter.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection by preventing acquisition of an image of amark target at the left front corner of the intersection in left-handtraffic or at the right front corner of the intersection in right-handtraffic.

A second aspect of the disclosure relates to a non-transitory storagemedium storing an image transmission program that transmits a capturedimage of a mark target to an information center. The image transmissionprogram transmits the image to the information center in a case wherethe mark target is inconspicuous at an intersection, and does nottransmit the image to the information center in a case where the marktarget is conspicuous at the intersection.

For this reason, it is possible to reduce the acquisition amount ofimages by transmitting an image of an inconspicuous mark target at anintersection to the information center.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection.

In the non-transitory storage medium according to the second aspect ofthe disclosure, the case where the mark target is inconspicuous at theintersection may be a case where the mark target is located and anoccupancy ratio of an occupancy area of the mark target in a block ofthe minimum range divided by a plurality of roads to an area of theblock is less than a given ratio.

For this reason, it is possible to reduce the acquisition amount ofimages by transmitting an image of an inconspicuous mark target havingan occupancy ratio of an occupancy area occupying a block to an area ofthe block less than a given ratio at an intersection to the informationcenter.

Accordingly, it is possible to provide a non-transitory storage mediumstoring an image transmission program capable of efficiently collectingan image at an intersection.

A third aspect of the disclosure relates to an image transmission devicethat is mounted in a vehicle having an imaging unit configured to imagesurroundings of the vehicle to acquire an image and a communication unitconfigured to perform communication with an information center. Theimage transmission device includes an image acquisition unit configuredto, in a case where a certain mark target is located at an intersection,and an occupancy ratio of an occupancy area of the mark target in ablock of a minimum range divided by a plurality of roads to an area ofthe block is equal to or less than a given ratio, cause the imaging unitto acquire an image of the intersection including the mark target, and atransmission controller configured to cause the communication unit totransmit the image acquired to the information center.

For this reason, it is possible to reduce the acquisition amount ofimages by acquiring an image in a case where the occupancy ratio of theoccupancy area of the mark target in the block to the area of the blockis equal to or less than the given ratio.

Accordingly, it is possible to provide an image transmission devicecapable of efficiently collecting an image at an intersection.

A fourth aspect of the disclosure relates to an image transmissionmethod that is executed on an in-vehicle device mounted in a vehiclehaving an imaging unit configured to image surroundings of the vehicleto acquire an image and a communication unit configured to performcommunication with an information center. The image transmission methodincludes, in a case where a certain mark target is located at anintersection, and an occupancy ratio of an occupancy area of the marktarget in a block of a minimum range divided by a plurality of roads toan area of the block is equal to or less than a given ratio, causing theimaging unit to acquire an image of the intersection including the marktarget; and causing the communication unit to transmit the imageacquired to the information center.

It is possible to provide a non-transitory storage medium storing animage transmission program, an image transmission device, and an imagetransmission method capable of efficiently collecting an image at anintersection.

BRIEF DESCRIPTION OF THE DRAWINGS

Features, advantages, and technical and industrial significance ofexemplary embodiments of the disclosure will be described below withreference to the accompanying drawings, in which like numerals denotelike elements, and wherein:

FIG. 1 is a diagram showing the configuration of a route guidance systemincluding a vehicle, a probe storage server, and a navigation server;

FIG. 2A is a diagram showing the positional relationship of roads,intersections, and a major supermarket;

FIG. 2B is a diagram showing the positional relationship of roads,intersections, and a major supermarket;

FIG. 2C is a diagram showing the positional relationship of roads,intersections, and a major supermarket;

FIG. 3 is a diagram showing the data structure of a database having anintersection ID, a latitude/longitude, an image ID, and a POI associatedwith one another;

FIG. 4 is a flowchart showing processing that is performed by an imagetransmission device;

FIG. 5 is a flowchart showing processing that is performed by a probecontroller of the probe storage server; and

FIG. 6 is a flowchart showing processing that is performed by asignboard guide creation unit of the probe storage server.

DETAILED DESCRIPTION OF EMBODIMENTS

Hereinafter, an embodiment to which a non-transitory storage mediumstoring an image transmission program, an image transmission device, andan image transmission method of the disclosure are applied will bedescribed.

Embodiment

FIG. 1 is a diagram showing the configuration of a route guidance systemincluding a vehicle 10, a probe storage server 500A, and a navigationserver 500B. In the vehicle 10, a navigation electric control unit (ECU)100, a camera 200, and a data communication module (DCM) 300 aremounted. The navigation ECU 100, the camera 200, and the DCM 300 areconnected to perform communication with one another through a controllerarea network (CAN) 50 as an example. The navigation ECU 100 can performwireless data communication with the probe storage server 500A and thenavigation server 500B through the DCM 300 and a network 400. The probestorage server 500A and the navigation server 500B are an example of aninformation center or a data center needed for route guidance.

Although a form in which the CAN 50 based on a CAN protocol is used as anetwork inside the vehicle 10 has been described, a bus other than aCAN, such as a bus using an Ethernet (Registered Trademark) protocol,may be used instead of the CAN 50. Although various devices or equipmentother than the above-described devices or equipment are mounted in thevehicle 10, in FIG. 1, constituent elements particularly related to theembodiment are extracted and shown.

The vehicle 10 is, for example, a hybrid vehicle (HV), a plug-in hybridvehicle (PHV), an electric vehicle (EV), a gasoline vehicle, a dieselvehicle, or the like. The navigation ECU 100 is mounted in the vehicle10.

The navigation ECU 100 performs control of a navigation system mountedin the vehicle 10. The navigation ECU 100 includes an image transmissiondevice of the embodiment. Here, description will be provided focusing ona portion relating to the image transmission device in the navigationECU 100.

The navigation ECU 100 is implemented by a computer including a centralprocessing unit (CPU), a random access memory (RAM), a read only memory(ROM), a hard disk drive (HDD), an input/output interface, acommunication interface, an internal bus, and the like as an example.

A program that makes the computer as the navigation ECU 100 have afunction as an image transmission device is installed on the computerthrough a computer-readable storage medium or is downloaded from anothercomputer system through a modem or the like connected to the network400, such as the Internet, and installed on the computer.

The navigation ECU 100 includes a main controller 110, a positiondetection unit 120, an intersection detection unit 130, a route searchunit 140, an information acquisition unit 150, an acquisition needdetermination unit 160, an imaging controller 170, a communicationcontroller 180, and a memory 190. The main controller 110, the positiondetection unit 120, the intersection detection unit 130, the informationacquisition unit 150, the acquisition need determination unit 160, theimaging controller 170, and the communication controller 180 representthe functions of the program executed by the navigation ECU 100 asfunctional blocks. The memory 190 functionally represents a portion thatstores data like the RAM, the ROM, and the HDD included in thenavigation ECU 100. The information acquisition unit 150, theacquisition need determination unit 160, and the imaging controller 170constitute an image acquisition unit 101.

In the navigation ECU 100, at least the information acquisition unit150, the acquisition need determination unit 160, the imaging controller170, the communication controller 180, and the memory 190 constitute theimage transmission device. The image transmission device may furtherinclude the main controller 110, the position detection unit 120, or theintersection detection unit 130.

The main controller 110 is a processing unit that performs processingother than processing performed by the position detection unit 120, theintersection detection unit 130, the information acquisition unit 150,the acquisition need determination unit 160, the imaging controller 170,and the communication controller 180, and integrates processing of thenavigation ECU 100.

The position detection unit 120 is connected to a global positioningsystem (GPS) antenna, and acquires position data and time data from GPSsignals. The position data acquired by the position detection unit 120is data representing a current position (latitude and longitude) of thevehicle 10, and the time data is data representing a current time. Theposition data and the time data are used for processing that isperformed by the main controller 110, and are output to the CAN 50.

The intersection detection unit 130 detects an intersection in a movingdirection of the vehicle based on the current position of the vehicleand map data (electronic map). Specifically, the intersection detectionunit 130 acquires the current position of the vehicle obtained from thenavigation system and detects an intersection represented by a node inthe moving direction on a link representing a road including the currentposition in the map data.

The intersection detection unit 130 calculates a distance to theintersection based on the current position (latitude and longitude) ofthe vehicle obtained from the navigation system and a position (latitudeand longitude) of the intersection represented by the node in the movingdirection on the link representing the road, on which the vehicle istraveling currently, in the map data.

The route search unit 140 receives information, such as a destinationinput to the navigation system by a user of the vehicle 10 and transmitsinformation, such as the destination, and the position data representingthe current position of the vehicle 10 to the navigation server 500B.The route search unit 140 fits data of route guidance received from thenavigation server 500B to the map data and displays the data on adisplay of the navigation system. At this time, the route search unit140 displays a signboard guide image received from the navigation server500B on the side of an image of the intersection on the display, anddisplays guide display, such as “turn left at a OO intersection” on thedisplay. As described above, since the navigation server 500B searchesfor a route, it is possible to guide a more accurate route and a moreaccurate arrival time.

The information acquisition unit 150 acquires information, such as afacility, at the intersection from the map data stored in the memory190. Information, such as a facility, is point of interest (POI)information. The POI information represents an identifier (ID), a name,a category (genre), and a position (latitude and longitude) of a store,a facility, or the like along a road included in the map data. Afacility or the like is an example of a mark target that faces anintersection and can become a mark.

The acquisition need determination unit 160 determines an acquisitionneed of an image relating to an intersection for the camera 200 based onwhether or not the POI information satisfies a predetermined conditionthat the camera 200 is not caused to perform imaging. The reason fordetermining the acquisition need of the image as described above is asfollows; in a case where an image relating to an intersection isacquired by a probe traffic information collection function of thenavigation ECU 100 without determining the acquisition need of the imagerelating to the intersection, the number of images to be acquired mayincrease, the data capacity of image data uploaded from the navigationECU 100 to the probe storage server 500A may become enormous, and thecapacity of image data stored in the probe storage server 500A and thenavigation server 500B becomes also enormous. In order to restrain thedata capacity of image data uploaded in the above-described case or thecapacity of image data stored in the probe storage server 500A and thenavigation server 500B from becoming enormous, the acquisition need ofthe image is determined.

In a case where the POI information satisfies the predeterminedcondition, the acquisition need determination unit 160 determines thatacquisition of the image relating to the intersection by the camera 200is not needed, strictly selecting an image uploaded to the probe storageserver 500A and the navigation server 500B, and restrains the datacapacity of image data uploaded and the capacity of image data stored inthe probe storage server 500A and the navigation server 500B frombecoming enormous.

In a case where the acquisition need determination unit 160 determinesthat acquisition of the image relating to the intersection is needed,the imaging controller 170 causes the camera 200 to perform imaging andacquires the image relating to the intersection. The image relating tothe intersection is an image of a facility or the like to be a mark ofthe intersection in probe data (data, such as position data, the degreeof congestion, a vehicle speed, and images, obtained when the vehicletravels actually) collected by the probe traffic information collectionfunction. A way of selecting the image of the facility or the like to bea mark of the intersection will be described below along with thepredetermined condition.

The communication controller 180 causes the DCM 300 to transmit theimage relating to the intersection acquired by the imaging controller170 to the probe storage server 500A. The communication controller 180is an example of a transmission controller.

The memory 190 stores the map data, the image transmission program, dataneeded for executing the image transmission program, and the like. Thememory 190 is an example of a storage unit.

The camera 200 is an example of an imaging unit that captures around thevehicle 10 to acquire an image. A single or a plurality of cameras 200may be provided as long as images in front of and on the side of thevehicle 10 can be acquired. The camera 200 may be configured to acquirean image behind the vehicle in addition to the images in front of and onthe side of the vehicle 10.

The DCM 300 is an example of a communication unit or a wirelesscommunication device that is mounted in the vehicle 10, and for example,performs wireless communication through a communication line, such as3G, LTE, 4G, or 5G. The DCM 300 can be connected to a network 400, suchas the Internet, through the above-described communication line. Withthe above description, the navigation ECU 100 can perform datacommunication through the network 400. As an example, hereinafter, it isassumed that the DCM 300 performs wireless communication through 4G.

The probe storage server 500A is a server that collects and stores theprobe data uploaded from the navigation ECU 100 of the vehicle 10through the DCM 300. The probe storage server 500A has a controller510A, a communication unit 511A, a probe controller 512A, and asignboard guide creation unit 513A. The probe storage server 500A isconnected to a traveling database (DB) 600A.

The controller 510A is implemented by a computer including a CPU, a RAM,a ROM, an HDD, an input/output interface, a communication interface, aninternal bus, and the like. The communication unit 511A, the probecontroller 512A, and the signboard guide creation unit 513A of thecontroller 510A represent the functions of the program executed by thecontroller 510A as functional blocks.

The communication unit 511A is a communication interface that isconnected to the network 400. The probe storage server 500A is connectedto the network 400 through the communication unit 511A, and performswireless data communication with the navigation ECU 100 of the vehicle10. Although one vehicle 10 is shown in FIG. 1, since there is actuallya plurality of vehicles 10, the communication unit 511A performswireless data communication with the navigation ECUs 100 of the vehicles10.

The probe controller 512A stores the probe data (data, such as positiondata, the degree of congestion, the vehicle speed, and images, obtainedwhen the vehicle 10 travels actually) uploaded from the navigation ECU100 of the vehicle 10 in the traveling DB 600A.

The signboard guide creation unit 513A recognizes the image of thefacility or the like to be a mark of the intersection in the probe datastored in the traveling DB 600A by the probe controller 512A throughimage processing, and stores the image in the signboard guide DB 600B.

The navigation server 500B is a server that searches for a route andcalculates a predicted arrival time according to a request from thenavigation ECU 100 of the vehicle 10, and that transmits data of thesearched route, the predicted arrival time, and the image of thefacility or the like to be a mark of the intersection included in thesearched route to the navigation ECU 100 of the vehicle 10.

The navigation server 500B has a controller 510B, a communication unit511B, a route search unit 512B, and a route guidance unit 513B.

The controller 510B is implemented by a computer including a CPU, a RAM,a ROM, an HDD, an input/output interface, a communication interface, aninternal bus, and the like. The communication unit 511B, the routesearch unit 512B, and the route guidance unit 513B of the controller510B represent the functions of the program executed by the controller510B as functional blocks.

The communication unit 511B is a communication interface that isconnected to the network 400. The navigation server 500B is connected tothe network 400 through the communication unit 511B, and performswireless data communication with the navigation ECU 100 of the vehicle10. Although the single vehicle 10 is shown in FIG. 1, since there isactually a plurality of vehicles 10, the communication unit 511Bperforms wireless data communication with the navigation ECUs 100 of thevehicles 10.

The route search unit 512B performs communication with the navigationECU 100 of the vehicle 10, and searches for the route and calculates thepredicted arrival time based on information of a destination or the liketransmitted from the route search unit 140 and the position data. Theroute search unit 512B transmits data representing the calculatedsearched route and the predicted arrival time to the navigation ECU 100of the vehicle 10.

The route guidance unit 513B reads data of the image of the facility orthe like to be a mark of the intersection associated with a nodeincluded in the searched route from the signboard guide DB 600B, andtransmits the read data to the navigation ECU 100 of the vehicle 10along with data representing the searched route and the calculatedpredicted arrival time.

The predetermined condition in selecting the image of the facility orthe like to be a mark of the intersection will be described. FIGS. 2A to2C are diagrams showing the positional relationship of roads,intersections, and a major supermarket. FIGS. 2A to 2C schematicallyshow display on the display of the navigation system. Here, as anexample, it is assumed that the vehicle 10 is traveling in a left-handtraffic country or area.

In FIGS. 2A to 2C, the vehicle 10 is moving in a direction (upwarddirection in the drawing) indicated by an arrow along a road 1. In themoving direction of the vehicle 10, there are roads 2, 3, 4 that crossthe road 1. There is a road 5 that is parallel to the road 1. The road 5is positioned on the left side by one block from the road 1 in themoving direction of the vehicle 10. The road 1 and the roads 2, 3, 4cross each other at intersections 1A, 1B, 1C. The road 5 and the roads2, 3, 4 cross each other at intersections 5A, 5B, 5C. The roads 1, 2, 3,4, 5 are represented by links of the map data, and have unique IDs,respectively. The intersections 1A, 1B, 1C, 5A, 5B, 5C are representedby nodes of the map data, and have unique IDs, respectively.

As an example, in a case where the vehicle 10 approaches a position 300m before an intersection, an image transmission device 100 of thevehicle 10 calculates a distance to the intersection based on thelatitude and longitude of a node representing the intersection and thelatitude and longitude representing a current position of the vehicle10. The detection of the intersection and the calculation of thedistance are performed by the intersection detection unit 130.

Then, the image transmission device 100 reads a POI of a facility or thelike having data of the same latitude and longitude as the latitude andlongitude of the node representing the intersection or a POI of afacility or the like having data of the latitude and longitude with adifference in latitude and longitude from the node representing theintersection equal to or less than a predetermined value from the memory190, and determines the type of facility based on a name and a category(genre) of the facility or the like represented by the POI.

Reading the POI as described above is to estimate a facility facing theintersection. Facing the intersection refers to that a facility ispositioned at a corner of the intersection or a facility is at aposition, not a corner, facing the intersection like an end portion of aT-shaped road. The predetermined value of the difference in latitude andlongitude refers to a difference that may be generated in a case wherethe latitude and longitude of the node representing the intersection aredifferent from the latitude and longitude of the POI of the facility orthe like facing the intersection.

In a case where there is the POI of the facility or the like facing theintersection as described above, the image transmission device 100determines the need for acquisition of an image of the facility or thelike represented by the POI in the following manner. Here, although acase where the image transmission device 100 determines the need forimage acquisition to a facility facing the intersection 1B will bedescribed, the same applies to facilities facing the intersections 1A,1C, 5A, 5B, 5C.

Here, although the image transmission device 100 determines not toacquire an image of a facility or the like on the right side of theintersection 1B of the left-hand traffic road 1 since there is apossibility that the visual field of the camera 200 is obstructed by avehicle traveling on an oncoming lane, a median, a roadside tree, or thelike, the image transmission device 100 determines the need for imageacquisition as follows to a facility or the like at the left frontcorner of the intersection 1B in order to restrain the data capacity ofuploaded image data and the capacity of image data stored in the probestorage server 500A and the navigation server 500B from becomingenormous.

As shown in FIG. 2A, it is assumed that there is a major supermarket SPof a famous chain on the left front side of the intersection 1B. Theuser of the vehicle 10 easily views the vehicle 10 traveling on theleft-hand traffic road 1, and the major supermarket SP on the left frontside of the intersection 1B in front of the vehicle 10 easily comes intothe field of view. The major supermarket SP is a large supermarket thatoccupies one block surrounded by the roads 1, 2, 3, 5. It is assumedthat one block is 200 m square as an example. The major supermarket SPdescribed above is conspicuous to the user of the vehicle 10. One blockis a block of the minimum range divided by a plurality of roads. Theroads dividing one block are roads included in the map data (electronicmap).

Here, determination about whether or not one block is large may be madeby reading the size of one block from the map data stored in the memory190 with the acquisition need determination unit 160 of the imagetransmission device 100, and determining whether or not one block at theleft front corner of the intersection is equal to or greater than, forexample, 200 m square.

Determination about whether or not the major supermarket SP occupies onelarge block may be made by reading the size of a facility or the likerepresented by a POI for one block understood as one large block fromthe map data stored in the memory 190 with the acquisition needdetermination unit 160, and determining whether or not the facility orthe like represented by the POI occupies one block.

The major supermarket SP is known to many users and becomes a mark easyto understand. In particular, the major supermarket SP occupying oneblock is conspicuous, and there is a high probability that the majorsupermarket SP is recognized by the user even though an image is notacquired. For this reason, the image transmission device 100 determinesthat acquisition of the image of the major supermarket SP occupying oneblock on the left front side of the intersection 1B is not needed inorder to reduce the capacity of uploaded image data or stored imagedata. The determination described above is performed by the acquisitionneed determination unit 160. Here, although a case where the facility orthe like occupying one block is the major supermarket SP has beendescribed, determination that acquisition of an image is not needed asdescribed above is not limited to a large facility, such as the majorsupermarket SP, and may be made to a large facility or the like otherthan the major supermarket SP. For example, a large department store,factory, hotel, or the like may be applied.

In FIG. 2A, although a form in which, in a case where a large facility,such as the major supermarket SP, at the left front corner of theintersection occupies one block, determination is made that acquisitionof an image is not needed has been described, even though a facilitydoes not occupy one block, in a case where a facility occupies apredetermined ratio or more of one block at the left front corner of theintersection, determination may be made that acquisition of an image isnot needed. This is because a facility or the like having the ratiooccupying one block equal to or greater than the predetermined ratio isa conspicuous facility. A facility or the like having an occupancy ratioless than a given ratio is an inconspicuous facility or the like.

For example, the predetermined ratio may be set to 50%, and indetermining whether or not a facility occupies an area of 50% or more ofone block, the acquisition need determination unit 160 may calculate thearea of one block and the area of a large facility, such as the majorsupermarket SP, from the map data, may determine whether or not the arearatio is equal to or greater than 50%, and in a case where the arearatio is equal to or greater than 50%, may determine that acquisition ofan image is not needed. For this reason, an image of an inconspicuousfacility or the like having the area ratio less than 50% is uploaded tothe probe storage server 500A. The predetermined ratio may be set to anappropriate value, and is preferably equal to or greater than 50%.

Calculating the area of one block from the map data may be regarded ascalculating the land area of one block, and calculating an occupied areaof a facility or the like in one block may be regarded as calculating anoccupied land area of a facility or the like in one block.

In FIG. 2B, in a case where a facility, such as a store 6, differentfrom the major supermarket SP is disposed at the left front corner ofthe intersection 1B of the major supermarket SP shown in FIG. 2A, thestore 6 is smaller than the major supermarket SP, the major supermarketSP is conspicuous to the user, and there is a probability that the store6 is recognized by the user even though an image is not acquired; thus,the image transmission device 100 determines that acquisition of theimage of the major supermarket SP occupying one block on the left frontside of the intersection 1B is not needed in order to reduce thecapacity of uploaded image data or stored image data.

As shown in FIG. 2C, it is assumed that there is the major supermarketSP in one large block on the left back side of the intersection 1B. Onelarge block on the left back side of the intersection 1B is a blocksurrounded by the roads 1, 3, 4, 5. Here, the term “large” has the samemeaning as in FIGS. 2A and 2B.

In a case where the major supermarket SP that is disposed substantiallyover one large block is positioned in one large block on the left backside of the intersection 1B, the major supermarket SP hardly becomes amark compared to a case where the major supermarket SP is positioned atthe left front corner of the intersection 1B as shown in FIGS. 2A and2B. This is because the major supermarket SP is too large, and thus, ishardly conspicuous compared to a case where the major supermarket SP ispositioned at the left front corner of the intersection 1B. For thisreason, the image transmission device 100 determines that acquisition ofthe image of the major supermarket SP in one block on the left back sideof the intersection 1B is needed. The determination described above isperformed by the acquisition need determination unit 160. In FIG. 2C,although the major supermarket SP has been described, the same appliesto a large facility, such as a large department store, factory, orhotel.

FIG. 3 is a diagram showing the data structure of a database having anintersection ID, a latitude/longitude, an image ID, and a POI associatedwith one another. The intersection ID is an ID of an intersection (node)included in the map data. The latitude/longitude represents the latitudeand longitude of each intersection. The image ID indicates an ID of animage acquired at each intersection. The POI is a POI of a facility orthe like included in the image represented by the image ID. FIG. 3 showsthe data structure of data stored in the navigation server 500B.

When the image transmission device 100 determines that acquisition of animage is needed, an image of a large facility or the like is stored inthe memory 190 as a part of the probe data, is uploaded to the probestorage server 500A, and is stored in the navigation server 500B.

FIG. 4 is a flowchart showing processing that is performed by the imagetransmission device 100.

As an example, in a case where an ignition switch is turned on, the maincontroller 110 starts the processing (START).

The position detection unit 120 acquires the current position of thevehicle 10 (Step S1).

The main controller 110 acquires data of a link (road) including thecurrent position of the vehicle 10 (Step S2).

The intersection detection unit 130 determines whether or not thevehicle 10 approaches an intersection in the moving direction (Step S3).Determination about whether or not the vehicle 10 approaches theintersection may be performed by acquiring the position (latitude,longitude) of the intersection (node) in the moving direction from themap data, calculating the distance between the current position of thevehicle 10 and the intersection, and determining whether or not thedistance between the current position and the intersection is equal toor shorter than 300 m.

In a case where the intersection detection unit 130 determines that thevehicle 10 approaches the intersection (S3: YES), the informationacquisition unit 150 acquires a POI of a facility or the like at theintersection from the map data stored in the memory 190 (Step S4).

The acquisition need determination unit 160 determines whether or notthe facility or the like represented by the POI is at the left frontcorner of the intersection (Step S5). Determination about whether or notthe facility is at the left front corner of the intersection may beperformed by determining whether or not the position of the POI is atthe left front corner with respect to the position (latitude, longitude)of the intersection acquired in Step S3.

In the processing of Step S5, in a case where the left back corner, theright corner (right front corner or right back corner) or the right sideof the intersection is the end, a POI of a facility or the like facingthe right side of the intersection is excluded from an image acquisitiontarget.

In a case where determination is made that the facility or the likerepresented by the POI is at the left front corner of the intersection(S5: YES), the acquisition need determination unit 160 calculates thearea of one block where the facility or the like represented by the POIis positioned and the area of the facility or the like represented bythe POI from the map data stored in the memory 190, and determineswhether or not the area of one block is equal to or greater than apredetermined area and the area of the facility or the like representedby the POI is equal to or greater than the predetermined ratio of thearea of one block (Step S6).

In a case where determination is made the area of one block is equal toor greater than the predetermined area and the area of the facility orthe like represented by the POI is equal to or greater than thepredetermined ratio of the area of one block (S6: YES), the acquisitionneed determination unit 160 determines whether or not the facility orthe like represented by the POI is a predetermined genre (Step S7). Thepredetermined genre used in Step S7 may be determined in advance andstored in the memory 190. The predetermined genre is, for example, amajor supermarket, a department store, a factory, a hotel, or the like.

In a case where determination is made that the facility is thepredetermined genre (S7: YES), the acquisition need determination unit160 determines that acquisition of the image of the facility or the likerepresented by the POI is not needed (Step S8). In a case where theprocessing of Step S8 ends, the main controller 110 returns the flow toStep S1.

In a case where determination is made that the facility or the likerepresented by the POI is not a predetermined genre (S7: NO), theacquisition need determination unit 160 determines that acquisition ofthe image of the facility or the like represented by the POI is needed(Step S9). This is because an image of a facility or the like other thanthe predetermined genre is acquired.

The imaging controller 170 causes the camera 200 to acquire an imagefrom a position 150 m before the intersection (Step S10). The camera 200captures an image, for example, at every 10 m, and the imagingcontroller 170 performs image processing for object recognition aboutwhether or not an object, such as a building, is included in the imageand selects an image including an object, such as a building, as animage for upload. The route search unit 140 may perform communicationwith the probe storage server 500A and may acquire position datarepresenting a position where an image should be acquired from the probestorage server 500A, and when the vehicle 10 arrives at the positionrepresented by the position data, the imaging controller 170 may causethe camera 200 to acquire an image.

The processing to Step S8 through Step S4, Step S5: YES, Step S6: YES,and Step S7: YES is processing that is performed by an image acquisitionunit 101 constituted by the information acquisition unit 150, theacquisition need determination unit 160, and the imaging controller 170.The processing to Step S9 through Step S4, Step S5: YES, Step S6: YES,and Step S7: NO is processing that, in a case where the occupancy ratioof the occupancy area of the mark target at the intersection in theblock to the area of the block is equal to or less than the given ratio,the image acquisition unit 101 causes the camera 200 to acquire theimage of the intersection including the mark target.

The main controller 110 causes the communication controller 180 toupload the image to the probe storage server 500A (Step S11). In theprocessing of Step S11, the probe data other than the image is alsouploaded to the probe storage server 500A along with the image. With theabove description, the probe storage server 500A receives the probe datafrom the image transmission device 100.

The main controller 110 determines whether or not to end the processing(Step S12). A case of ending the processing is, for example, when theignition switch is turned off. With the above, a sequence of processingends.

In Step S3, in a case where the intersection detection unit 130determines that the vehicle 10 does not approach the intersection (S3:NO), the main controller 110 returns the flow to Step S1.

In a case where the acquisition need determination unit 160 determinesthat the facility or the like represented by the POI is not at the leftfront corner of the intersection (S5: NO), the flow progresses to StepS8, and determination is made that acquisition of the image of thefacility or the like represented by the POI is not needed (Step S8).This is because there is no need for acquisition of the image of thefacility or the like at the left back corner of the intersection or onthe right side of the intersection.

In a case where determination is made that the area of one block isequal to or greater than the predetermined area and the area of thefacility or the like represented by the POI is not equal to or greaterthan the predetermined ratio of the area of one block (S6: NO), theacquisition need determination unit 160 determines that acquisition ofthe image of the facility or the like represented by the POI is needed(Step S9). This is because an image of a facility or the like having thearea of one block at the left front corner of the intersection less thanthe predetermined area or the area of the facility or the likerepresented by the POI less than the predetermined ratio of the area ofone block is acquired.

FIG. 5 is a flowchart showing processing that is performed by the probecontroller 512A of the probe storage server 500A. In a case where theprocessing starts (START), the probe controller 512A determines whetheror not the probe data is received from the image transmission device 100(Step S91).

In a case where determination is made that the probe data is received(S91: YES), the probe controller 512A stores the probe data in thetraveling DB 600A (Step S92). In a case where determination is made thatthe probe data is not received (S91: NO), the probe controller 512Arepeatedly performs the processing of Step S91. With the above, theprocessing for one cycle of a control cycle ends (END). The probecontroller 512A repeatedly performs the processing from START to END ina predetermined control cycle.

FIG. 6 is a flowchart showing processing that is performed by thesignboard guide creation unit 513A of the probe storage server 500A. Ina case where the processing starts (START), the signboard guide creationunit 513A determines whether or not probe data is added to the travelingDB 600A (Step S101).

In a case where determination is made that the probe data is added(S101: YES), the signboard guide creation unit 513A performs imagerecognition of a signboard to image data included in the probe data(Step S102). The image recognition of the signboard is processing forperforming recognition processing (image processing) about whether ornot a character, a number, or the like is included in the image datatransmitted from the image transmission device 100.

The signboard guide creation unit 513A determines whether or not thereis an image including a signboard in the processing of Step S102 (StepS103).

In a case where determination is made that there is an image including asignboard (S103: YES), the signboard guide creation unit 513A stores theimage in the signboard guide DB 600B along with the intersection ID, thelatitude/longitude, the image ID, and the POI (Step S104). With theabove description, new data is added to the database shown in FIG. 3.

In a case where the signboard guide creation unit 513A ends theprocessing of Step S104 or in a case where the signboard guide creationunit 513A determines in Step S103 that there is no image including asignboard (S103: NO), the processing for one cycle of a control cycleends (END). The signboard guide creation unit 513A repeatedly performsthe processing from START to END in a predetermined control cycle.

As described above, according to the embodiment, in a case where, inregard to the block where the facility or the like represented by thePOI at the left front corner of the intersection in the moving directionof vehicle 10 is positioned, the area of one block is equal to orgreater than the predetermined area and the area of the facility or thelike represented by the POI is equal to or greater than thepredetermined ratio of the area of one block, acquisition of an image issuppressed; thus, it is possible to restrain the data capacity ofuploaded image data or the capacity of image data stored in the probestorage server 500A and the navigation server 500B from becomingenormous.

Accordingly, it is possible to provide the non-transitory storage mediumstoring the image transmission program and the image transmission device100 capable of efficiently collecting an image at an intersection.

Although the processing in a case where the vehicle 10 travels on theleft-hand traffic road has been described above, in a case where thevehicle 10 travels on the right-hand traffic road, the right and left inthe above processing may be replaced with each other.

Although a form in which the route search unit 140 displays thesignboard guide image received from the navigation server 500B on theside of the image of the intersection on the display of the navigationsystem has been described above, the following may be performed insteadof displaying the signboard guide image or in addition to displaying thesignboard guide image. The navigation server 500B may perform at leastone of image processing and character recognition processing to thesignboard guide image to identify a facility name or the likerepresented by the signboard guide image and may display the identifiedfacility name or the like on the display or read out the facility namethrough voice guidance.

Although the non-transitory storage medium storing the imagetransmission program, the image transmission device, and the imagetransmission method according to the exemplary embodiment of thedisclosure have been described above, the disclosure is not limited tothe embodiment that is specifically disclosed, and various modificationsor alterations can be made without departing from the spirit and scopeof the disclosure.

What is claimed is:
 1. A non-transitory storage medium storing an imagetransmission program that is executed on an in-vehicle device mounted ina vehicle having an imaging unit configured to image surroundings of thevehicle to acquire an image and a communication unit configured toperform communication with an information center, the image transmissionprogram comprising: an image acquisition step of, in a case where acertain mark target is located at an intersection, and an occupancyratio of an occupancy area of the mark target in a block of a minimumrange divided by a plurality of roads to an area of the block is equalto or less than a given ratio, causing the imaging unit to acquire animage of the intersection including the mark target; and a transmissionstep of causing the communication unit to transmit the image acquired tothe information center.
 2. The non-transitory storage medium accordingto claim 1, wherein the image acquisition step of the image transmissionprogram includes causing the imaging unit not to acquire the image ofthe intersection including the mark target in a case where the marktarget is equal to or greater than a given ratio.
 3. The non-transitorystorage medium according to claim 1, wherein the image acquisition stepof the image transmission program includes causing the imaging unit notto acquire the image relating to the intersection in a case where theoccupancy ratio occupies the entire area of the block.
 4. Thenon-transitory storage medium according to claim 1, wherein the imageacquisition step of the image transmission program includes causing theimaging unit to acquire the image of the intersection including the marktarget at a place between a position in front of the intersection by apredetermined distance and the intersection.
 5. The non-transitorystorage medium according to claim 1, wherein the image acquisition stepof the image transmission program includes specifying the occupancyratio using map data.
 6. The non-transitory storage medium according toclaim 1, wherein the image acquisition step of the image transmissionprogram includes causing the imaging unit not to acquire the imagerelating to the intersection in a case where the mark target is apredetermined large facility.
 7. The non-transitory storage mediumaccording to claim 1, wherein the block is positioned at a left frontcorner of the intersection in left-hand traffic or at a right frontcorner of the intersection in right-hand traffic.
 8. A non-transitorystorage medium storing an image transmission program that transmits acaptured image of a mark target to an information center, wherein theimage transmission program transmits the image to the information centerin a case where the mark target is inconspicuous at an intersection, anddoes not transmit the image to the information center in a case wherethe mark target is conspicuous at the intersection.
 9. Thenon-transitory storage medium according to claim 8, wherein the casewhere the mark target is inconspicuous at the intersection is a casewhere the mark target is located and an occupancy ratio of an occupancyarea of the mark target in a block of a minimum range divided by aplurality of roads to an area of the block is less than a given ratio.10. An image transmission device that is mounted in a vehicle having animaging unit configured to image surroundings of the vehicle to acquirean image and a communication unit configured to perform communicationwith an information center, the image transmission device comprising anelectronic control unit configured to: cause, in a case where a certainmark target is located at an intersection, and an occupancy ratio of anoccupancy area of the mark target in a block of a minimum range dividedby a plurality of roads to an area of the block is equal to or less thana given ratio, the imaging unit to acquire an image of the intersectionincluding the mark target; and cause the communication unit to transmitthe image acquired to the information center.
 11. An image transmissionmethod that is executed on an in-vehicle device mounted in a vehiclehaving an imaging unit configured to image surroundings of the vehicleto acquire an image and a communication unit configured to performcommunication with an information center, the image transmission methodcomprising: in a case where a certain mark target is located at anintersection, and an occupancy ratio of an occupancy area of the marktarget in a block of a minimum range divided by a plurality of roads toan area of the block is equal to or less than a given ratio, causing theimaging unit to acquire an image of the intersection including the marktarget; and causing the communication unit to transmit the imageacquired to the information center.